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Abstract 

The widespread proliferation of Internet and wireless applications has produced a significant increase of ICT energy 
footprint. As a response, in the last five years, significant efforts have been undertaken to include energy-awareness 
into network management. Several green networking frameworks have been proposed by carefully managing the 
network routing and the power state of network devices. 

Even though approaches proposed differ based on network technologies and sleep modes of nodes and interfaces, 
they all aim at tailoring the active network resources to the varying traffic needs in order to minimize energy 
consumption. From a modeling point of view, this has several commonalities with classical network design and 
routing problems, even if with different objectives and in a dynamic context. 

With most researchers focused on addressing the complex and crucial technological aspects of green networking 
schemes, there has been so far little attention on understanding the modeling similarities and differences of pro¬ 
posed solutions. This paper fills the gap surveying the literature with optimization modeling glasses, following a 
tutorial approach that guides through the different components of the models with a unified symbolism. A detailed 
classification of the previous work based on the modeling issues included is also proposed. 
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1. Introduction 


The widespread of IGT has caused a significant increase of its energy footprint. In fact, the IGT sector alone 
produces at least 2% (0.8 Gt GO 2 per year) of global GHG emissions [l-^, exceeding even the amount of the 
aviation sector [ 4 I. Some studies expect this amount to reach the impressive value of 1.4 Gt of GO 2 per year by 
the end of 2020, which would account for approximately 2.8% of global emissions. According to 2007 figures, IGT 
power requirement was estimated to be within a range from 2% to 10% of global power consumption [y, Q, while 
the energy demand of network equipment, excluding servers in data centers, was around 22 GW with expectations 
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of reaching 95 GW in 2020 Other data related to energy consumption shows that telecom operators demand 
yew from 150 Twh/y in 2007 to 260 TWh/y in 2012, an amount that accounts for 3% of the total worldwide need 
Finally, other studies focusing on single Internet Service Provider (ISP) show that the energy consumed by the 
largest providers such as AT&T or China Mobile reached II TWh per year in 2010, while in the case of medium 
sized operators like Telecom Italia and GRNET the figures are expected to approach 400 GWh in 2015 

Although green techniques have been applied to almost any aspect of ICT with the aim of improving its energy 
efficiency, this survey specifically focuses on energy-aware management of IP networks. It is worth pointing out 
that for ISPs, about 20% of power consumption is due to the core/backbone, while the remaining 75% is consumed 
by the access/edge ones [l^ 111. However, technology upgrades and increa sing transmission rates are expected to 


increase the backbone portion up to 40% in 2017 


ij and 50% in 2020 Qi M- 


In recent years, a very large body of work has been published in the area of green networking, including a 
few survey papers. Even though there is a vast and specific literature on IP energy-aware management, to our 
knowledge, there has not been so far a thorough review and analysis of all the different modeling features of the 
related optimization problems. 

In this paper we present a tutorial-survey of this hot area of research. We first introduce the reader to the family 
of energy-aware network management (EANM) problems, by discussing step by step all their important modeling 
features. We then classify previous work based on the model characteristics identified and comment on the open 
issues. 

The paper is organized as follows. We provide a brief technological background and describe the features charac¬ 
terizing different problems within the general EANM framework in Section!^ In Section [3] we then discuss EANM 
from an optimization modeling perspective, guiding the reader through a series of mathematical programming mod¬ 
els representing the different problems addressed in the literature and highlighting the strong ties between energy 
management problems and the classical network design problems widely studied by the operations research commu¬ 
nity. Section 0] is the survey part of the paper, where the state of the art literature on EANM is classified according 
to different criteria representing some key characteristics of the models used. The last Section presents a wrap-up 
of the work that was carried out in the paper and provides some conclusive remarks. 


2. Energy-aware network management: a general overview 


IP networks can be made greener by working at different levels 


devices and architectures which offer support for sleeping primitives |I7| or pipeline IP forwarding 



by developing novel 


energy-efficient 


18|, by defining 


local procedures to autonomously adjust the state of a single network device according to real-time measurements 
[l^ , and by coordinating the management of the whole network infrastructure to optimize both energy consumption 
and performance of both routing and device configurations (EANM) 20l-l22l| . 


Practically speaking, the goal of EANM is to adapt the network consumption to the traffic levels. The way 


2 












EANM is performed relates to the following elements: (i) the power profile of network devices, (ii) the routing 
protocol, according to which traffic engineering is performed, (iii) the QoS requirements requested by each traffic 
flow, (iv) when and how frequently network re-configurations should be performed, i.e., in advance off-line or in 
real-time on-line, (v) where to locate the intelligence of the system (centralized or distributed architecture) and 
finally, (vi) network survivability in case of failures. 


2.1. Power profiles 

The power profile of a network device is its power consumption versus traffic load. Depending on the shape of 
the profile, the network can be operated in an energy-efficient manner accordin g to different policies. 

Assuming non-linear power profiles, different approaches can be considered 23|. For instance, in case of cubic 


power profiles, it would be more energy efficient to distribute the traffic among multiple devices to keep the average 
utilization as low as possible, while in presence of logarithmic profiles it would be much more effective to consolidate 
the traffic over a very restricted set of network elements. 

According to several recent studies, however, current network devices and their main components, e.g. router 


chassis and line cards, present an almost linear power profile with a pretty 


relatively small increase up to maximum consumption at full load 


[l5, 24- 


high consumption at zero load and 


26j| . The power needed to maintain a 


device active even with no load makes up around 90% of the energy consumed during peak utilization periods. We 
refer to the Powerlib database for an accurate collection of consumption figures for several networking devices, 
both IP and optical, produced by different vendors. Since in practice the profile is almost flat and energy savings 
can be achieved only switching off the device (sleep mode), power prohles are often approximated with an ON-OFF 
(step) curve. 

Although great efforts have been made to improve the load proportionality of the energy consumption of next 
generation network devices (see e.g. [2), the ON-OFF profile characterizes the current devices and makes sleeping 
the most promising and effective strategy to adapt the consumption of IP networks to the incoming traffic levels. 


Analytic studies such as 


[n | and P 


estimate that around 50% energy savings could be achieved. Furthermore, 


29l-l3l| remark that sleeping-based strategies remain effective when applied to network devices characterized by 


a utilization-proportional power profile provided that fixed and proportional consumption components are of the 
same order of magnitude. 

In addition to pure sleeping strategies, adaptive link rate (ALR) has been recently standardized by the IFFE 
802.3az engineering task force (33jto efficiently adapt the transmission peak rate, and thus the corresponding energy 


consumption, of Ethernet links 


According to ALR, the capacity of each Ethernet link is adjusted, e.g., from 


100 Mbps to 1 Gb ps o r from 1 Gbps to 10 Gbps, to satisfy the incoming traffic while transmitting at the less 
consuming bit-rate 


34 


. To date, the widespread of ALR has been slowed due to hardware and implementation 


issues. The ALR concept can be generalized by the notion of multi-line rate (MLR) 
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2.2. Routing Protocol 


Routing protocols have a major impact on traffic engineering techniques for distributing traffic load in the 
network, and therefore on the energy management polices that can select traffic routes to reduce the consumption 
or to put in sleep some nodes or links (line cards). 

In IP networks, we identify two main classes of routing protocols, i.e., flow based and shortest path based. When 
routing is flow based, like in the case of network based on Multi-Protocol Label Switching (MPLS), each traffic 


demand is routed along one or multiple dedicated paths 


. In this case, traffic engineering is very flexible because 


routing paths can be selected by the network administrator. However, optimizing the routing paths for each traffic 
demand can be computationally expensive and require a non negligible signaling overhead whenever a path update 
is performed. 

When shortest-path routing is adopted [^, like with classical IP destination based forwarding, the shortest 
paths are determined according to link weights. Therefore, traffic engineering approaches aiming at minimizing 
energy consumption can be performed by adjusting the link weights. However, since packet forwarding is based on 
destination address only, not all the combination of paths can be selected and all traffic flows to the same destination 
must follow the same path(s) regardless of their origins. 

From the practical point of view, shortest path routing allows the network administrator to modify only a 
set of link weights, one for each link, which can be easily updated through state-of-the-art management technolo¬ 
gies. However, routing configurations are more constrained and optimization problems become much even more 
computationally challenging. 

Note that both flow based and shortest path routing can be either based on single path or multiple paths (per 
flow or destination, respectively) . 


2.3. QoS Constraints 

Making IP networks greener should not jeopardize their quality of service (QoS). A first trivial way to avoid 
congestion and guarantee the QoS is leaving some spare capacity to cope with unpredictable traffic variations and 
device failures. This is commonly achieved by network operators by imposing a maximum utilization threshold on 
both network routers and links. 

An alternative strategy (see, e.g., |^ 1 is to define a convex non-linear function to represent the cost of link/router 
saturation and to optimize the configuration based on such function. 

In case of elastic traffic, where flow rates are dynamically adjusted by congestion control mechanisms, the QoS 


objectives can be translated into the maximization of utility functions of the rates achievable by each demand 


m 


2 . 4 . Network Survivability and Robustness 

Perfectly tailoring the active capacity to the incoming traffic level is clearly the natural way to maximally 
reduce the network consumption. However, though costly from the energy perspective, some spare capacity should 
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be always available to cope with unexpected events, including device failures and unexpected traffic variations. 
There always exists a trade off between energy efficiency and network resilience/robustness. 


2.5. Frequency of network updating 

Even though Internet traffic is intrinsically variable, it is typically characterized by a daily/weekly periodic 
profile Ql, which allows network administrators to estimate the traffic expected in forthcoming days. However, even 
the most accurate prediction is always affected by some uncertainty. 

Therefore, network engineers must address the following issues: (i) is it better to optimize network configuration 
in advance according to traffic predictions (planning phase), or in real-time considering direct traffic measurements? 
(ii) How often must the network be reconfigured to avoid QoS degradation and optimally reduce energy consumption? 

The accuracy of off-line approaches is related to the precision of traffic predictions. Assuming that traffic demands 
are well estimated, off-line methods present two main advantages. First, the time available to run EANM algorithms 
is quite large (in the order of hours), allowing the implementation of more complex procedures. Secondly, optimizing 
in advance allows the careful evaluation of the solutions before their application. However, off-line methods offer 
scarce flexibility in reacting to unexpected conditions. 

As for on-line approaches which adapt network configuration to real-time measurements, they guarantee prompt 
reactions to unexpected traffic variations and device failures, but, at the same time drastically reduce the available 
computational time. 

The off-line/on-line nature of the approach also influences the optimization frequency. A common practice 
for off-line methods is to exploit the slow and periodic dynamics of Internet traffic to identify in advance a few 
time instances which will trigger pre-determined configuration updates. Limiting the number of times a network is 
reconfigured may cause issues in terms of (i) gap between the energy consumed by the currently applied configuration 
and that requested by the one optimized for the real traffic amount, and (ii) potential inability to meet the requested 
QoS requirements due to unexpected events. However, recent work have shown that in current IP networks quasi- 
optimal savings and desired QoS could be achieved through a limited number of network configurations (in terms 


of routing and device states) to be efficiently applied along an entire day 


29 


30|. 


Differently, with on-line frameworks, the network can be reconfigured every time is needed, but too frequent 
re-configurations should be avoided to preserve network stability and limit the signalling overhead. 

Note that off-line and on-line optimization can be effectively combined to achieve performance optimality as 
well as network stability and responsiveness to failures. 


2.6. Distributed vs centralized decisions 

EANM can be implemented in a global and coordinated fashion by a centralized entity, e.g., a network manage¬ 
ment platform, or in a local and distributed manner by means of multiple network agents which are able to locally 
adjust the configuration and converge towards a stable network configuration. 
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Centralized approaches manage the entire network as a whole, relying on a set of global measurements which 
potentially allow to determine quasi-optimal configurations. However, centralized mechanisms are typically compu¬ 
tationally complex, require a substantial amount of computing power, and rely on dedicated architectures to collect 
data and disseminate configuration instructions. 

Conversely, distributed schemes generally exploit limited amounts of local data. They base their strength on 
speed and simplicity. As expected, these features make very hard to approach solution optimality. It is worth 
pointing out that centralized EANM is usually implemented off-line, while distributed EANM is generally used for 
on-line mechanisms. 


3. Energy-Aware Network Optimization Modeling 


The issue of managing the network to reduce its power consumption can be modeled as a mathematical pro¬ 
gramming problem. The formulation varies according to the considered network scenario so as to include all the 
problem features, e.g., routing scheme, energy components, QoS measures. Energy Aware Network Management 
(EANM) problems are strictly related to another class of optimization problems called Network Design (ND). ND 


shares many 


instance, 


wi.. EANM, i. E. Eee„ ».e„.ve,v s.M.d i„ .Ee ... Ea, fe. 


421, [43l| . Chapter ”An annotated bibliography in communication network design and routing” of 


m 


In this section, we present several mathematical models, starting from the basic EANM problem and then 
including other network and problem features. We will point out the features common to ND problems, and those 
which are specific of EANM problems. This tutorial part is meant to assist green networking experts to identify 
the specific optimization problem which they are interested in or they are working on. We believe that, in both 
operation research and engineering communities, being always aware of which is the right reference model is crucial 
to better exploit the existing literature to rigorously compare novel proposals with state of the art. 


3.1. Basic Energy-Aware Network Management Problem 

Let us consider an IP network topology composed by routers and links connecting them. The network can be 
represented by a directed graph G = (EA), where the set of nodes V represents the routers and the set of arcs A 
represents the links. Let Cij > 0 be the link capacity. Traffic is represented by a set of demands D. Each traffic 
demand d e D is described by a source node o‘^, a destination node and a non-negative bandwidth request r^. 

The IP-Basic Energy-Aware Network Management (IP-BEANM) problem asks to route the set of demands so 
as to minimize the network energy consumption. To represent flow of demand d on each arc (by), we introduce 
non-negative variables ffj. Additional variables fjj and fi can be introduced to represent the total traffic carried by 
link {i, ]) e A and total traffic entering node i e V, respectively. Note that the flow traversing a node is the sum of 
the flows entering the node plus the demands originating by such a node. 
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Different functions have been used to model network energy consumption. Energy consumption is commonly 
represented as the sum of the link energy consumption and the node energy consumption n, (/i). In IP- 

BEANM such functions are assumed to be continuous and non-decreasing. 

The general notation is summarized in Table [TJ 


Table 1: Elements of the basic problem 


Sets 

V 

Network nodes 

A c y X y 

Network links 

D 

Traffic demands 


Parameters 



Origin of demand d 


Destination of demand d 


Traffic request for demand d 


Card capacity on link (/, j) 


Consumption function for link (i, j) 

n,■(/;■) 

Consumption function for node i 

Variables 

f- 

Amount of flow of demand d and on link (/, J) 

fij 

Total amount of flow carried by link (/, j) 

fi 

Total amount of flow carried by node i 


The arc based model for IP-BEANM is the following: 



min J] 

(!,7)eA 

ieV 


(1) 



if i - o‘^ 



Z fii 

jeV. 

(D)<^ 

jeV- 

if i = 

'^ieVdeD 

(2) 

0 otherwise 





deD 

V(/,7)eA 

(3) 


II 

+ 

V/ e y 

(4) 



fiJ ^ Cij 

V(/,J)eA 

(5) 



ffj^^ 

V(f, j) e A, d e D 

(6) 



fij ^ 0 

V(/,7)6A 

(7) 



f>0 

V/e y 

(8) 


Objective function o minimizes the network power consumption due to flow on arcs and through nodes. Plow 
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conservation constraints @ ensure that each trafSc demand is routed from its source to its destination, while 
constraints m and compute the bandwidth requirements for links and nodes, respectively. Link capacity are 
enforced by constraints Inequalities (jl])-® give the variable domain. Different formulations can be taken into 
account without significantly changing the structure of the problem (for example considering the in-out flow for 
node capacity and not only in flow). 

If only arc energy consumption is considered and functions II,y(-) are linear - i.e. 11,y = ~ then the term 

Diev n,' {fi) in the objective function disappears, and variables fi and constraints I®) are no longer necessary and can 
be discarded. The resulting model is the following: 


min 2 (9) 




(i,j)eA deD 




II 


2d- 

jeV. 

2d = - 

jeV: 

W)cA 

1 

A. 

II 

> 

< 

(10) 

0 otherwise 




V(d7)eA 

deD 

(11) 



ffj>0, \/(iJ)eA,deD 

(12) 


Formulation (|9|) - (I12I) represents a multicommodity flow problem (see Chapter 17 of 


m 


The multicommodity flow problem with continuous flow variables can be polynomially solved. The multicom¬ 
modity integral flow problem, instead consider integer flow variables and it is NP-complete in its decision form, even 
if only two commodities and unitary capacities are considered (see Appendix of |46l|L 


We observe that, in the multicommodity model, node cost or capacity can be accounted for by splitting the 
nodes. Each node i is replaced by two nodes i', and i", one representing the input side of i, the other representing 
the output side. The arc between i and i' accounts for node i capacity and cost. The size of the problem will grow 
to 2N nodes and A + N arcs (see Chapter 2 of 


43)- 


Besides linear objective functions, non-linear, both convex and non-convex functions 


47 


49j, are considered in 


the literature. Piece-wise linear approximations may be applied when convex functions are minimized, (see e.g., 
3 47|), still preserving linearity of the formulation. Convex non-linear functions have also been used to model 
other kind of costs/objectives such as delays in the urban networks or con gest ion in communication networks and 
such applications are widely addressed in the literature (see Chapter 14 of [45| and 50|). 
















3.1.1. Alternative formulations 


An alternative formulation uses per-source (or destination) routing scheme [M |. j^. 22|). Continuous non¬ 
negative real variables fl are introduced that represent the amount of traffic carried by link (f, j) and generated by 
node s. Flow conservation constraints as well as total link flow constraints are replaced by: 


ZdeD:o‘‘=s if ! = i 



jeV: 



jeV-. 


0 


A3deD:l^^i,o‘‘ = S’ 


otherwise 


VseV,ieV 


V(/J)6A 


(13) 


(14) 


With per-source routing, we pass from |A||D| to |A||y| flow variables and from |y||Z)| to |y||y| flow conservation 
constraints, considerably reducing the model size, if the number of demands |Z)| is larger than the number of nodes 
|y|. It is worth pointing out that the routing of each demand can be easily derived from a feasible solution of the 
per-source model. 

Another alternative is to consider per-path routing, where the potential routing paths of each demand d & D 
are explicitly collected into the set P‘‘. A fractionary variable e [0,1] is introduced for each demand d that 
represents the fraction of sent along path p e . Constraints ([2]) and ® are replaced by 


Z = 1- 

peP^‘ 

VdeD, 

(15) 


V(q;)6A. 

(16) 


peP': 


Equations (fT5)l replace flow balancing constraints and ensures that all the incoming traffic is sent along the 
paths in P‘‘. Constraints (flHll compute the bandwidth requested on link {i,j). 

The per-path formulation requires the full description of path set P^ for each demand. However, as the paths 
are exponentially many, it is often described in an implicit way applying column generation approaches. 


3.2. Unsplittahle Routing 

To simplify network management tasks and avoid complex operations such as packet reordering, network admin¬ 
istrator prefer to adopt a single path routing scheme. We can observe that simply asking for integer flow variables 
will not be sufficient to guarantee having a single path for each demand. To obtain single path routing, binary 
variables xffj e {0,1} are introduced, which are equal to one if link (i, j) is used by demand d. Furthermore, constraints 
must be modified as follows: 
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1 Hi — Od, 


\/ieV,deD (17) 

-id, fie A (18) 

Constraints (II3 replace flow balancing constraints, while equations m determine the total flow carried by 
each arc. We can observe that for the per-path routing, asking variables to be binary is sufficient to obtain a 
single path routing. On the contrary, per-source (per-destination) routing are not suitable to model unsplittable 
demands. 

3.3. Congestion reduction constraint 

Network congestion is usually prevented by the network operator by means of a maximum link utilization 
threshold fiij. In this case capacity constraints ([5]) will become: 

fij<^iijCij 'id, fie A (19) 




x‘‘ 


jeV. 

(O)eA 


jeV: 

O'.OeA 


— 1 if 1 = td, 

0 otherwise 


Z ^4 = fc 


deD 


We can observe that this modification does not change the structure of the problem, in fact simply scaling by the 
coefficient the capacity of arc (i, j) will result in the same constraint of IP-BEANM. From now on we will consider 
the constraint with congestion reduction mechanism, in fact, when no congestion reduction is considered it can be 
obtained setting /dij — 1. 


3 . 4 . Sleeping capabilities 

The consumption profile of current network devices is quite well approximated by an ON-OFF (step) curve 


Q, 24-3): 


that means that the static consumption component, i.e., the energy required to keep a device on, 
represents more than 90% of the total power required by a fully used device. Indeed, most papers on energy-aware 
network management ignore utilization-based energy costs and considers only a fixed consumption tt; for each active 
node i e V and ntj for each active link (qy) e A. The energy footprint of the network is thus reduced by putting to 
sleep unused network devices. 

To model the power state of both routers and links, binary variables y; and Wjj are introduced which are equal 
to 1 if node i e V and link dfi) ^ A, respectively, are powered on. The energy consumption to be minimized is thus: 


(i,j)eA ieV 
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Capacity constraints (O must be modified and additional constraints must be included: 


fij < PijCijWij 

V(/,7 )eA, 

(21) 

Wij < yi. 

L(i,j)eA 

(22) 

Wij < yj. 

L(i,j)eA 

(23) 


Constraints m prevent routing a demand through a sleeping link, and replace constraints ([S]). Constraints (j22l) - 
forbid the activation of a link connected to a sleeping router. If tt; = 0, the second term of the objective function 
can be neglected and all routers are assumed to be always active: constraints (l22l) and (l23l) can be neglected , as 
well. The resulting model shares the structure with the Network Design problem, where a minimum cost subset of 
arcs must be selected (see [42|). 


S.5. Bundled Links, Adaptive Link Rate and Multi-Line rate 
3.5.1. Bundled links 

A single network link (i,j) e A can be seen as a bundle of n,y line cards (or cables) of the same type, namely 
having the same capacity and same power consumption. Each line card can be switched on or off independently 
from the others, so as to reduce the energy consumption if less than riij cards are needed. Binary variables w,y are 
not suitable for describing the possible statuses of a link, thus, when bundled links are considered, Wij are integer 
non-negative variables: e [o,..., n,yj, representing the number of active line cards on each link. Furthermore, 

constraints (1^ and (1^ should be slightly modified: 


Wij < riijji, V(b j) e A 

Wij<nijyj, L{i,j)eA 


(24) 

(25) 


The Network Loading problem with modular capacity, namely the problem of allocating the minimum cost 
number of modular capacity devices on network arcs, has a similar model structure (see 42l|'). 


3.5.2. Adaptive Link Rate (ALR) and Multi-Line rate (MLR) 

According to ALR or MLR, each link can work at different rates with specific speed and energy consumption. 
For instance, Ethernet links can be operated at four different rates, i.e., 10 Mbps, 100 Mbps, 1 Gbps and 10 Gbps, 
each one with a particular consumption requirement: switc hing from 100 Mbps to 1 Gbps requires 4 additional 
Watts, while for 10 Gbps links the increment is around 15 W [Sg. MLR can be similarly implemented by means of 
the so-called channel bonding according to which a virtual link is mapped over multiple physical links which, 


in this energy-aware case, can be activated only one at a time. 
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The set Eij containing the different working configurations e is introduced for each link (/, j) e A. Each configura¬ 
tion e e Ejj is described by a capacity c^.. and a fixed consumption, ;rb. Note that link sleeping status is represented 
by a configuration with zero capacity and zero consumption. Such configuration does not request the activation of 
the end points. Furthermore, link state variables Wij must be replaced by variables vvb which are equal to 1 if link 
{i, i) is operated with configuration e. 

The objective accounts for the power of the configuration used by each link: 

min ^ ^;rbwb + ^;r,y,-, (26) 

eeEij ieV 

Constraints inii-iEsi) must be restated and configuration selection constraints must be added: 


e&Ej j 

V(fi;)eA 

(27) 

e&Ej j 

V(i,j)eA 

(28) 

e^Ejj. 


(29) 

Z <j ^ yp 

e^Ejj. 

V(i,j)eA 

(30) 


Constraints ensure that only one configuration is selected for each link, while constraints ((28ll guarantee that 
link maximum utilization threshold of the chosen link configuration is not exceed. Finally, constraints (IMli-dsol), 
which are a restated version of the original (l22l) - (l23)l . allow to select a non-zero capacity configuration for a link 
(/, j) 6 A only if the chassis are active on both sides of link (i, j) itself. 

3.6. Protection from single link failures 

The energy consumption of communications networks is typically optimized by putting to sleep the redundant 
resources at both link and node levels, as mentioned before. However, the need for greener networks should not 
compromise the capability of the networks to react to unexpected events such as device failures. Failure events are 
usually handled by automatic protection mechanisms that redirect the traffic over still working routes. The most 
popular strategy is to reserve backup bandwidth. Being link failures, and even more node failures, a very unlikely 
event, the majority of protection mechanisms is focused on managing single link failures. 

The most straightforward form of protection is known as point-to-point protection, where a backup path is 
computed for each demand, independent from the fault. Primary and backup paths must be link disjoint. This 
protection strategy can be implemented in networks operated with flow-based routing protocol, e.g., MPLS, and 
configured to allow single path routing only. 
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To model point-to-point protection, backup paths variable and flow conservation constraints are needed. Let 
be the binary variables which are equal to 1 if link (i, j) e A is used by the backup path of demand d & D. The 
additional constraints to represent the protection scheme are: 



1 if ! = Od, 



jeV: jeV: 

ii,j)eA (jJ)eA 

1 

II 

'ii eV, d e D 

(31) 

0 otherwise, 





V(/, j) e A, d e D 

(32) 


4 + 4 ^ 1 ’ 

V(b j) e A, d e D. 

(33) 


Constraint m are the flow conservation for the backup paths, while (I32I) - (I33|) guarantee that primary and 
backup paths are link disjoint. 

Furthermore, it is necessary to modify capacity constraints to account also for backup flows. The way backup 
flow is computed differentiates different kinds of end-to-end protection schemes. The most used are the dedicated 
and the shared one. The dedicated protection scheme reserves the same amount of bandwidth on each link of the 
primary and the backup paths. The dimensioning constraint (I18|) is replace by: 

+ V(b;)6A (34) 

deD 

which accounts both for the primary and the backup flows. 

As simultaneous link failures are assumed to never occur, shared protection aims at reducing the reserved backup 
capacity by allowing backup paths to share resources, if their primary paths are failure disjoint. In fact, under the 
single link failure assumption these backup paths will never be activated simultaneously. Therefore, different link 
failures require different amounts of capacity for each link. The backup capacity to be reserved for each link is 
forced by the failure scenario which requires the highest possible backup capacity, i.e. the failure that affects the 
highest amount of demands. 

To correctly compute the backup bandwidth reserved on each link, binary variables are introduced, which 
are equal to 1 if traffic demand c/ £ Z) is rerouted on link (/, j) e A when a failure occurs on link {k,l) £ A (i.e. if 
traffic demand deD uses a primary and a backup paths routed, respectively, on link (i,j) £ A and link (k,l) e A). 
The following constraints replace (1341) to respect the link maximum utilization: 
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V(i, j), {k,l) e A, d e D, 

(35) 

Xi''44+ 4 , 7 ) = /if 

V(i,j),(k,DeA. 

(36) 


deD 


3. 7. Multi-Periodicity 

In IP networks, traffic conditions are not constant but vary throughout the day. Accordingly, the network 
configuration can be adjusted to accommodate the incoming level of traffic. Each change of configuration may 
result in an additional energy consumption due to reactivation of sleeping elements. Furthermore, the number of 
changes can be limited for instance by constraining the changes of routing paths or the number of reactivation 
for a specific device, in fact too frequent state switching could negatively affect the device lifetime. The resulting 
multiperiod problem consists in planning network configuration along a g iven time horizon, so as to minimize the 


overall network energy consumption. As shown in some recent studies 


29,3 , due to the slow dynamic of Internet 


traffic, a few time periods with a duration in the order of hours are enough to provide a good representation of 
traffic. 

The former models can be extended to take into account multiperiodicity. Let S denotes the set of time periods 
in the considered time horizon. Demand varies in different time periods: let denote the amount of traffic of 
demand d in time period cr. As the traffic variations are usually cyclic, the multiperiod problem must account also 
for the transition between the last and the first period. Single period path variables xtjj are replaced by the variables 
which are equal to I if link (/, j) 6 A is used to route demand deD during period cr e S. All the other variables 


are changed accordingly. Routing constraints should be defined for each single time period: 


1 if ! = o‘^ 


Z 

jeV. 


•*0 


z 

jeV. 

U,i)eA 


^d<r 


^ -1 if ! = Vi eV, d & D, s e S 
0 otherwise 


V(i,j)eA,VseS 

deD 


(37) 


(38) 

(39) 


The optimal solution of the multi-period problem cannot be reached by treating independently each time period, 
as inter-period constraints are considered, which account for energy consumption due device reactivation, limit in 
the number of reactivations, or in the number of changes in routing paths. 

Let non-negative real variables z‘J denote the energy consumed by chassis j eV ii it is activated at the beginning 


14 







of period cr e S and binary variables denote the activation state of line card k: they are equal to 1 if the A:-th 
line card of link (i, j) e A is activated from the sleeping state at the beginning of period cr e S. 

The value of variables z is computed accordingly to the following constraints: 


zj > 6 nj (yj - yj , V; e y, cr 6 5, (40) 

where d is a parameter in [0,1] representing the additional fraction of the nominal chassis consumption which is 
consumed to reactivate chassis j e V. 

Being t]o„ the maximum number of reactivations allowed to each line card along the whole time-horizon, the 
switching limit is imposed by means of: 


X Kjk ^ j) ^ A, ere S 

A-=l 

^ ulj,^ < T]on, V(i, j)eA, kei^l,..., n,;}. 

creS 


(41) 

(42) 


Eq. (1411) forces the model to reactivate the required number of line cards at the beginning of each time period, 
while Eq. (H21) impose the reactivation limit for each single line card. 

Finally, let us consider the path adjustment limitation. To use the same paths along the whole time horizon 
we can consider the same flow or path variables (according to which variables are required by the single period 
problem) for all the time periods keep the original flow conservation constraints (they are not defined for all cr e 5). 


3.8. Shortest path routing models 

When network routing follows a shortest path scheme such as, for instance, in IP networks operated with the very 
popular OSPF routing protocol, the path used by each demand cannot be explicitly selected, but it is indirectly 
determined by the set of administrative weights manually assigned by the network administrator. This scheme, 
which, from a practical perspective, scales well with respect to the number of traffic demands (the number of link 
weights is always the same), is typically exploited to route best effort traffic. 

To favor load balancing and prevent network congestion, shortest path protocols are usually instructed to respect 
the so-called Equal Cost Multi-Path (ECMP) rule, according to which, at each node, a certain traffic demand is 
equally split among all the outgoing line cards belonging to at least one shortest path toward the corresponding 
destination. 

When routing is shortest-path, performing traffic engineering, i.e., optimizing the routing paths, is equivalent to 
adjusting the link weights. To model link weight optimization new variables and constraints must be introduced. 
Let u'.j be the binary variables which are equal to 1 if link (/, j) e A lies on a shortest path between i and node f, let 
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z\ bet the non-negative real variables which represent the amount of bandwidth reserved on all the outgoing links 
of i which belong to at least a shortest path from i to f. Finally, let 1‘- be the non-negative real variables accounting 
for the minimum distance between i and t, and let be the non-negative real variables which report the link 
weight of link {i,i) e A. Being M a large enough constant, shortest path routing is modeled by adding the following 
constraints Q, 


1 

VI 

1 

VI 

o 

deD-. 

td=t 

Vf e V, (/, J) e A 

(43) 

VI 

<j Z 

d^D: 

td^t 

Vf 6 V, (i, j) e A 

(44) 

0 <l'j + cjij u'.pM, 

Vf e F (i, j) e A 

(45) 

i/'j < fj + (jJij — fi, Vf 6 V, (/, y) € A 


(46) 


u\j < Wij, 

Vf e V, (i, j) e A 

(47) 

> (1 

— Wij)ti)max, 

V(h;)eA 

(48) 

1 < 

^ij — ^maxi 

V(h7)eA 

(49) 


e {0,1}, 

Vf e y, (i, j) e A 

(50) 


4- "d ^ 0- 

V/i, f e y (i, j) e A. 

(51) 


Constraints ensure that the ECMP rule is respected by correctly splitting among the outgoing interfaces 

the traffic which crosses each node: that means, (i) the whole traffic destined to node t e V is equally split among 
all the outgoing interfaces belonging to at least one shortest path toward t, and (ii) no traffic is routed on the 
remaining line cards. Shortest path constraints (I45p - (I46|) define the relationship between shortest paths and link 
weights, while constraints (ITTll - H^ are used to correctly configure the weight of the sleeping links. Constraints (H71) 
state that a sleeping link cannot belong to any shortest path, constraints (l48l) force the weight of a sleeping link to 
assume the maximum vale tOmax, and constraints (1491) define the existence domain of link weight variables. Finally 
the domain of the remaining variables is expressed by constrains @-(151]). 

Shortest path constraints introduce signihcant complexity which makes the resulting trafhc engineering problems 
hardly tractable by classic exact approaches (both energy-unaware Q and energy-aware Q problems). Therefore, 
heuristic methods are naturally preferred in literature to handle this class of problems. For the sake of completeness, 
we refer the reader to for a non-linear mixed-integer formulation which addresses the energy-aware traffic 
engineering problem with shortest path routing by considering a per-path approach. 
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3.9. Other peculiar features 

3.9.1. Other forms of protection 

If needed, other survivability features can be modelled, such as multiple failures, Shared risk groups, or restora¬ 
tion mechanisms. All such features have been addressed in the Network Design literature. In particular, the smart 
protection paradigm has been proposed for accounting for energy consumption in case of failure. The failures are a 
very unlikely event and the failed links are reasonably assumed to be promptly restored. Therefore a link hosting 
only backup paths is needed only for short time and its consumption is negligible compared with the one of links 
hosting primary paths. Thus, the objective energy function depends only on primary paths flows. 

3.9.2. Elastic traffic 

Although traffic demands are typically considered as inelastic, i.e., with a fixed transmission rate, it is worth 
pointing out that all the traffic flow carried by the very popular TCP protocol are by definition elastic. That means 
that the rate of a given flow is dynamically determined by the distributed congestion control mechanisms of TCP 
(or other technologies) to maximally exploit the capacity available on the routing path. When multiple flows share 
the same network resources, the role of the congestion control mechanisms is to distribute the contended resources 
in a fair manner among the concurrent demands. In case of elastic traffic, the network administrator has no control 
on the flow rates, which are uniquely determined by the congestion control mechanism according to the routing 
paths chosen by the administrator itself. 


nn 


3.9.3. Robustness 

Another important aspect concerns the intrinsic uncertainty which affects traffic demands |54l . l55j| . Classic tech¬ 
niques for Robust Optimization in ILP flow problems can be naturally adapted to account for traffic variation in 
the energy-aware network management scenario. In particular, we refer the reader to the cardinality constrained 
method proposed by Bertsimas et al. 5^, which considers uncertain traffic demands varying within a close sym¬ 


metric interval centered around their nominal expected values. 


4. Literature review 

The classifications presented in Sections [2] and [3] is here exploited to present a detailed literature review on 
EANM approaches. When not explicitly declared in the reference paper, we personally derive the optimization 
problem solved by each discussed procedure. Proposals are split on two major families, i.e., flow-based routing and 
shortest part routing strategies. In what follows, we first describe how the different articles were classified. Next, 
we enter in-depth into the main features of each set of articles, depending on whether they belong to the flow-based, 
shortest path or “other” routing strategies. 
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J^.l. Literature classification 

The classification of the vast literature review, is done on two axes. First, for each of the two major routing 
strategies, the articles are classified according to the problem features, as presented in Section [3l Tables [2] and |3] rep¬ 
resent that classification. The tables contain the referenced papers, and entries stating whether the problem treated 
considered on-off nodes, bundle links, elastic consumption, special QoS constraints, protection or survivability or 
(un)sphttable routing. The tables are concluded with special notes concerning the proposals presented. 

Observing the two tables, one can see, above all, that there are much more articles that deal with flow-based 
routing and that among them, the large majority deals with some form of ALR and with unsplittable routing. 
Some work deal with elastic consumption and surprisingly few consider multi period, survivability or special QoS 
constraints. 
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Table 2: Literature classification according to problem features: flow-based routing 


Problem 

Nodes 

off 

MLR, ALR, 
Bundled Links 

Elastic 

consumpt. 

Multiperiod 

Special QoS 
constraints 

Traffic 

Unaware 

Protection, 

Survivability 

Unsplittable 

routing 

Special 

features 

Work 











X 

X 


X 




X 


[^1 

X 

X 


X 




X 


[59, 60] 

X 

X 


X 



X 

X 

Smart protection 

[54] 

X 

X 


X 




X 

Robustness 

[611 

X 

X 


X 



X 

X 

Robustness, Smart protection 

[411 

X 







X 

Elastic traffic 

M 

X 


X 






Bi-objective function 

[241 

X 








Network design decisions 

[211 


X 








122. 63-671 

X 









[23, £3 

X 

X 

X 






Piece-wise concave 
energy costs 

[681 

X 


X 






Bidirectional link capacity 

[691 


X 

X 







[701 

[711 


X 








[721 


X 






X 


[73. 741 

X 

X 








[75. 761 

X 

X 








[771 


X 







Multi-topology routing 

[78. 791 


X 







Energy-Levels 

180-831 

X 








Node expansion. Multiple 
sleeping states 

148. 841 


X 

X 







[851 

X 




X 



X 


[861 



X 





X 


187. 881 

X 


X 


X 

X 


X 


[891 








X 


[901 

X 


X 


X 



X 


m 



X 


X 




Bi-objective function for energy 
and delay 

[921 


X 


X 



X 

X 

hop-by-hop routing 

[93.^ 

X 



X 



X 

X 

Two macro-periods 

[951 


X 






X 


[961 

[971 



X 







[55, 98, 991 

X 








Redundancy elimination 

1100. 1011 

X 

X 

X 





X 


[Ml 

X 

X 





X 


Approximated shared and 
dedicated protection 

[1031 

X 


X 




X 

X 


11041 


X 





X 


Failure probabilities 









































Problem 

Nodes 

off 

Table 3: Literature classification according to problem features: shortest path routing 

MLR, ALR, Elastic Multi eriod Special QoS Traffic Protection, Unsplittable 

Bundled Links consumpt. ^ constraints Unaware Survivability routing 

Special notes 

Work 

[20. 105-1071 

X 

X 


Lexicographic obj., ECMP 
routing 

[108] 

X 



Node expansion — Multiple 
sleeping states 

[1091 

X 



New power state 

[1101 


X 

X 


[1111 


X 


ECMP and robustness 





Fully splittable 

[1121 




free splitting ratio 

[113. 1141 






[115, 


X 

X 

link loads considered 

[117. 1181 


X 

X 

OSPF is modified 

[1191 



X 

OSPF is modified 

[120] 


X 

X 

Single node failures 


















Table 4: Literature classification according to resolution approaches: flow based routing 

Features Centralized Distributed Exact Heuristic Online Offline 

Work 

[57j 

X 

X (MILP) 

X 

X 

X 

m 

X 


X 


X 


X 

X (MILP) 

X 


X 

m 

X 

X (MILP) 

X 


X 

m 

X 

X (MILP) 

X 


X 


X 

X (MILP) 

X 


X 

m 

X 

X (MILP) 



X 


X 


X 

X 


m\ 

X 

X (MILP) 



X 

[22] 

X 

X (MILP) 

X 

X 


[^-^ 

X 


X 

X 


[23,47] 

X 

X (MILP) 

X 


X 

[^-76 , 78, 79] 

X 


X 

X 


[77] 


X 

X 

X 


m 

X 

X (MILP) 



X 

IM-M 

X 


X 

X 


m 


X 

X 

X 


m 


X 

X 

X 

X 

m,Mi 

X 


X 

X 


[^,M 


X 

X 

X 


[89] 


X 

X 

X 


[90] 

X 


X 

X 


[91,^ 


X 

X 

X 



X 


X 


X 

m 


X 

X 

x(TE) 

X (PATH) 

m 

X 


X 

X 


[97] 

X 


X 


X 

[^,98. Ml 

X 


X 


X 

[100, 

X 

X (MILP) 

X 

X 


\m 

X 

X (MILP) 



X 

m\ 

X 

X (MILP) 



X 

\m 

X 


X 

X 

X 


The second axis of classification are the resolution approaches. Tables |4] and [5] show, for the flow-based and 
shortest path based routing, respectively, which of the articles deal with centralized, distributed, exact, heuristic, 
on-line or off-line algorithms. We can see that for both types of routing, the majority of the proposals are centralized 
and on-line. Heuristic approaches are used in an overwhelming manner and they are the totality of the work that 
deal with shortest path routing. 


4-2. Detailed description 
4-2.1. Flow-based Routing 

Some of the most popular studies on 
problem m adapted to model sleeping 


EANM, [22, 63-651, explicitly address the variant of the IP-BEANM 


capabilities (see Section 15^ . We recall that (i) routing is flow based 
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Table 5: Literature classification according to resolution approaches: shortest path routing 

Features Centralized Distributed Exact Heuristic Online Offline 


Work 

120. in5. infi] 

X 


X 


X 

[M] 

X 


X 

X 


\m 

X 


X 

X 


11091 

X 


X 

X 


m 

X 


X 


X 

[m] 

X 


X 


X 

mi 

X 


X 

X 

X 

[112] 

X 


X 

X 

X 

[113, 

X 


X 

X 

X 

[115, 


X 

X 

X 


[117, 

X 


X 

X 

X 

iim 

X 


X 

X 

X 

[120] 

X 


X 


X 


and fully splittable, that is, flow variables ffj are real and nonnegative, (ii) the objective function minimizes the 
fixed energy cost paid to keep a node (router) or a link (network interface) in the active state and no proportional 
consumption component is considered, i.e., objective function o is replaced by ([20]), (hi) link capacity constraints 
(|5|) are adjusted as in (I21L (iv) each link is assumed to be made by a single network interface or line card, i.e.. 


riij - 1, V(!, y) £ A. The MILP formulation presented in 


63|-|65| is solved only in 


22 |, where the authors propose 


some little refinements to reduce the MILP complexity, as switching to a per-source routing scheme. Note that the 
proposed MILP presents an alternative formulation for the node activation constraints (I22II23I) . which is based on 
the use of a big-M parameters M: 


(i,j)eA (i,i)eA 


Mi e y. 


(52) 


Note that this formulation is dominated by (I22II23|) . and therefore is less effective. Furthermore the choice of 
parameter M can greatly affect the efficiency of the formulation. 

The main contribution of these papers is a standard greedy algorithm which, after sorting nodes and links 
according to a specific criterion, tries to put to sleep each element of the ordered list. The inputs of the procedure 
are the traffic matrix, the network topology with link capacities, and a set of link weights (considered only by the 
algorithm, not by the routing protocol) used to determine the network routing according to a shortest path scheme. 
A network element is put to sleep only if the weight set of the active elements determines a feasible routing which 
satisfies maximum utilization constraints (I^Tl) . In ^2, 63-65| different sorting policies are progressively proposed 
and tested. 

The presented algorithms are intended to be run by a centralized management platform in control of the whole 
network and able to estimate the current traffic matrix. Furthermore, due to the very-low time requirements, they 
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are meant to be performed periodically, in real-time, about every thirty minutes. The authors do not explicitly 
investigate the issues of stability and re-configuration frequency. 

Another early work to deal in a centralized manner with the IP-BEANM problem is [^|, where three MILP 
formulations with fully splittable routing are proposed, solved and evaluated in terms of performance and network 
survivability. Both flow proportional and fixed power consumption components are considered, and a bi-objective 
function is designed to find the trade-off between energy-savings and network performances. 

The same problem addressed in 


approach to improve upon 


64l | is considered in 


, where the authors propose a heuristic centralized 


64| . The method first exploits a state-of-the-art steiner-tree algorithm to compute the 


minimal set of nodes to be switched on to guarantee the network connectivity (all the links connecting activated 
nodes are kept on at this stage). Sleeping nodes are then progressively activated, together with their links, until the 


maximum utilization constraints (1211) are satisfied. Finally, a scheme very similar to that used in 


22 , 


631465 1 allows 


to put to sleep the largest possible set of links. The feasibility test that verifies link utilization constraint violation 
is done by computing K-shortest paths for each traffic demand, and by successively running a state-of-the-art bin 
packing algorithm to choose the best routing paths. The proposed procedure is meant to be run online every five 
minutes to dynamically adapt the network configuration to the incoming traffic. 

A variant of the greedy algorithm of 


64| is presented in 


67| . where multiple shortest paths are tested for each 


traffic demand to verify whether a node deactivation would cause congestion. 
A similar centralized online approach is presented in 


70( 1 where, however, only links (line cards) can be put to 


sleep. In addition to an extensive analysis on the problem complexity, the authors propose another greedy heuristic 
very similar to those just discussed. In this case, the feasibility test is done by sequentially routing each demand 
on the shortest path defined by the ratio between the residual and the full capacity. A centralized online strategy 
based on a greedy algorithm for the IP-BEANM problem with sleep-capable links is illustrated in 
sorting criteria is the link importance within the network, which is represented by its Shapley value. 

Flow-proportional convex energy costs related to the so-called route-processor are included in 
approach is again chosen to solve the problem. In 


96 1: the link 


scheme is the same of 


68 


. A greedy 


both nodes and links can be put to sleep. The heuristic 


64| . except for the feasibility test, which is performed by solving an LP formulation to 


n 


compute a routing configuration which does not violate the link capacity. In [69j, only links can be put to sleep 
and multiple line cards are considered on each link, i.e., nq > 1 (bundled links). The same greedy scheme of 


is adapted to cope with the new problem. At each iteration a single line card is considered for the switching off, 
and the Fast Greedy Heuristic presented in Q is solved to avoid maximum utilization constraint violation. These 
approaches are centralized and could be applied online as they have small computational time. 

The formulations presented and heuristically tackled in [681 169| are later solved in 23], |^|. The convex non¬ 
linear energy terms are linearized trough a piece-wise linear approximation (see, e.g., [40 ). The resolution approach 
requires a substantial amount of time and is only suitable for offline optimization. In 90| the authors solve a IP- 
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BEANM problem with sleep capable links, nodes with proportional power profile, single path routing and additional 
QoS constraints, i.e., maximum utilization constraints, maximum hop number, and what the authors call disjoint 
multi-route divergence. The procedure is based on brute force generation and testing the largest possible number 
of routing configurations. 

A different perspective to address the IP-BEANM problem with both fixed and proportional energy costs is 
assumed in and 


8 J|. In 


48l | an online distributed procedure according to which each edge router (those gener¬ 


ating traffic) is periodically responsible for adjusting the amount of traffic sent through the pre-defined transmitting 
paths: the aim is to minimize the consumption of the network links. The distributed procedure is equivalent to 
a classic local-search algorithms. Different shifting moves are included according to the shape of the device power 
profiles, which can be ON-OFE prevalent or step-wise proportional (ALR-likewise). Since pre-defined paths are 
used, the corresponding optimization problem should consider a per-path routing scheme (see Section 


second distributed approach of the same authors to solve the same optimization problem is presented in 


XTD . A 


841. In this 


case the pre-defined set of paths is optimized in advance with the aim of identifying those critical paths that should 
always be kept on to guarantee the connectivity while using the minimal number of links. A new on-line distributed 
architecture called REsPoNse is then responsible to adjust the portion of traffic sent on each pre-computed path. 
The set of pre-computed paths is split among critical always-on paths and on-demand paths that can be exploited 
in case of congestion or device failures. 

an admission control scheme to put to sleep both links and nodes is proposed. Once a flow demand (traffic 


In 


demand) is received from the network controller, the less consuming feasible single path is computed and assigned. 
From the optimization methodology perspective, these framework implements a greedy scheme which sequentially 
route each traffic request d & D. Note that in case of saturation some traffic demands may not be accepted into 
the system, which is equivalent to accepting an unfeasible solution for the corresponding optimization problem. A 


very similar greedy scheme is adopted in 


to solve the basic EANM problem: traffic demands are sorted and 


routed one by one on the best path, in terms of incremental energy consumption, chosen from a set of precomputed 
K-shortest paths. 

the same optimization problem is addressed by means of a distributed architecture called DAISES for 


In 


IP/MPLS. The framework dynamically adjusts the single path (the Label Switched Path) of each traffic demand by 
computing the shortest-paths determined by a set of link weights which are both energy consumption and congestion 
related. Energy/congestion related weights are considered in 91| too, where, w.r.t. [89l| the optimization problem 


assume routing to be fully splittable. The weights are exploited by the proposed hop-by-hop r outin g protocol to 
practically implement, in a distributed way, a variant of the well-known flow-deviation method 


12l|. Hop-by-hop 


routing mechanisms are also discussed in 9^ , where the goal is to dynamically minimize the link consumption in a 
MLR scenario by considering energy related link weights to choose the less consuming route toward the destination. 
Another distributed routing mechanism is proposed in 


87| and 


to dynamically minimize link and node 
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consumption while exploiting the concept of trajfic centrality, which, given a node i 6 V, is the ratio between the 
traffic carried by the most loaded outgoing link and the total outgoing traffic. The authors claim that maximizing 
this amount for each node is equivalent to minimizing power consumption, however that holds only under very 
specific conditions. Each node chooses with a certain probability the interface used to forward each flow. The 
probabilities change according to delay measures taken by ant probes transmitted through the network. In this 
case the routing is fully splittable since this probability-based forwarding exploits all the outgoing interfaces whose 
choice probability is greater than zero. Furthermore, the method is traffic unaware because no traffic matrix is 
required. 

The IP-BEANM problem adapted for the bundled links case with fully splittable routing (see Section [3. 5. II) has 
been largely addressed in the literature. If no specified otherwise, the next frameworks considering with bundled 
links are all meant to be employed in a centralized online fashion. In Q , which was the first work to appear, the 
authors present three different heuristic algorithms, i.e., Fast Greedy Heuristic (FGH), Exhaustive Greedy Heuristic 
(EGH) and Hi-level Greedy Heuristic (BGH), to quickly determine the sub-optimal set of line cards to be put to 
sleep. To this purpose, a specific LP formulation to maximize the network spare capacity is solved at each iteration 
to verify whether one of the active cables of the bundle with more spare capacity can be switched off without 
saturating the network. EGH and BGH involve some variants aimed at avoiding local optima. 

The same problem with single-path routing (see Section [3.2l) is addressed in [72 j, where two proposed procedures 
are based on the computation of the K-shortest-paths of each source-destination pair. These paths are exploited 
to determine, at each iteration, if there exist a routing co nfig uration which satisfy maximum utilization constraints 
every time a cable is put to sleep. In other two articles [tJ ] and Q , the same authors consider another problem 
variant, according to which nodes can be put to sleep, routing is fully splittable and a pre-computed set of paths 
is given as input to the model {per-path routing). The formulations presented in 0 and 0| contain several flaws 


and fail to correctly identify the real problem addressed. The input path set is composed of the K-shortest paths 
that satisfy each demand d e D. The same scheme already used in many approaches already mentioned is used to 
put to sleep the elements. Every time a cable or a node is tested for s leep ing, a heuristic procedure is called to find 
an alternative feasible routing on the residual network. Note that in 7^ the pre-computed paths cannot be longer 


than a certain threshold, but since paths are provided in input, that is not translated into an additional group of 
constraints for the corresponding optimization problem. 

Another variant with sleeping nodes, sleeping cables and classic per-flow fully splittable routing is considered in 
[0 , where, again, shortest-path-based and tree-based algorithms are combined to maximize the number of sleeping 
nodes. Though we consider only IP problems, let us cite 76|, where a pseudo-multi-layer IP over WDM variant 


of the classic bundled links problem is addressed. We refer to this work as pseudo-multi-layer because the WDM 
elements is introduced by simply naming the cables of each bundle as logical links of the optical layer: there is no 


fundamental difference with respect to 


75l |. A MILP formulation and a LR heuristic are presented and tested. 
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Line cards formed by multiple ports (equivalent to bundled links) are considered in 


2l|, where a complete 


formulation for the IP-BEANM problem with fixed energy cost on line cards and network ports, fully splittable 
routing and constraints on maximum utilization is reported. To rapidly find a sub-optimal solution the authors 
propose to modify the base MILP and switch to a per-path routing based on K precomputed paths. These paths 
are selected to respect constraints on the maximum number of hop or on the maximum propagation delay. The 
methodology is meant to be applied online every 15 minutes in a centralized manner. 


H, 


A very different approach with respect to the literature already mentioned is adopted in iza , where the IP- 
BEANM problem with bundled links is handled in a distributed manner: each node is allowed to decide the 
splitting ratios within a pre-defined set of paths. Note that, although this work is based on multi-topology routing, 
with each topology defined by a specific set of link weights and shortest path routing over each single topology, the 
high level abstraction of the problem does not fall in the class of shortest path routing, but in that of flow-based 
per-path one: for each demand a pre-defined set of paths determined by the multiple virtual topologies is given as 
input, and the framework decides which path should be chosen. 

Another distributed online approach for the IP-BEANM problem with bundled links is presented in The 


authors propose to use the backup path already set up by the MPLS protocol to aggregate the traffic on a smaller 
number of network line cards. Each router can independently choose if using the primary or the backup path 
to forward the flowing demands. From the optimization model perspective, this framework heuristically solves a 
per-path version of the IP-BEANM problem, with a couple of available paths for each demand, i.e., the primary 
and the backup one. Some tabu parameters are used to forbid shifting the flow on a link already impacted by other 
shifting moves. 

A new online centralized management architecture for IP/MPLS networks relying on novel optimizat ion algo¬ 
rithm s to optimize device states (routers, ports and links) by considering single-path routing is described in |lOcj| and 


I0I| . Multiple power states are defined for each link, each one characterized by specific capacity and consumption 


values. Both a standard per-arc and a per-path formulation based on pre-computed paths are given. A heuristic 
built on the linear relaxation of an incremental model and progressive variable fixing are proposed. 

Differently from a bundled link configuration, when ALR is considered, the network manager has to decide 
the operational rate of each link: in [to, 79 |, the authors evaluate how the number of operational rates available 
(energy-levels in the papers) impacts on the potential energy savings. To solve the BEAN problem adapted as 
shown in Section 13.5.21 to account for ALR, the authors propose two novel heuristic procedures based, respectively, 
on a genetic algorithm and on particle swarm optimization. 

A novel perspectives in flow-based EANM problems is introduced by 


n 


and |109f . which consider and 


model different power states of routers and line cards in addition to the classic ON-OFF. In 


is presented the 


first modeling of special stand-by states, according to which only some routing/forwarding functions are available 
or not. Besides sleeping and active states, the authors introduce the following operational states for network routers 
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(nodes): (i) bridged-all, (ii) bridged-local, (iii) default-gateway and (iv) bridged-many. An exact MILP formulation 


is presented and evaluated. This approach is suitable for a centralized offline implementation. 

in [^1, 


The same problem is addressed in a heuristic fashion 
algorithm is prop osed. A power state for routers is introduced in 
line-cards in 


where a procedure based on the Floyd-Warshall 


while the new stand-by states are applied to 


. To solve all the problems the authors present a novel ad-hoc heuristic. Either 


m 


831 and 


could be applied online in a centralized way. 

The first work dealing with a very special multi-period optimization problem is 


94| (preliminary version in 


m 


who propose a centralized off-line approach aiming at computing a low consumption configuration to be applied 
during the low traffic periods, and a more consuming one required during the peak phases. Multi-periodicity is here 
addressed in a different way with respect to what is shown in Section r3.71 since one of the variables of the optimization 
problem is the duration of the applicability period for the low consumption configuration. The proposed heuristic 
first follows a greedy mechanism like that of 6^ to put to sleep the links for the less loaded traffic matrix. Then 


the links are progressively re-added into the active topology to guarantee capacity constraints for the more loaded 
traffic matrices and, finally, the algorithm chooses the low traffic configuration according to the product between 
the energy consumption and the applicability window duration. The algorithm is adjusted to account also for single 
link failure protection: during the greedy procedure it is necessary to check whether, after the elimination of a link, 
the current link weight setting is still able to satisfy capacity constraints in case of failure of any other active links. 
To the best of our knowledge, tl^only other work to explicitly address a multi-period IP-BEANM problem with 
flow-based routing are 


58j | and [^. In 


57l| . two MILP exact formulations are presented, the first assumes a fixed 


routing configuration along the whole set of time periods, and the second allowing the network administrator to 
modify the routing path at the beginning of each new time interval. Multiple line cards are considered on each link 
(bundled links), maximum utilization constraints are imposed, energy savings are achieved by putting to sleep line 
cards and router chassis and by limiting the reactivation of the latter (reactivation causes a consumption spike). 
Furthermore, limitations on the maximum number of times that a single line card can be switched on within the 
whole set of periods are enforced to preserve the line card lifetime (see Section 13.71) . In 58| a novel heuristic to 


quickly find a sub-optimal solution for the two previous formulations is proposed. The algorithm is based on a 
GRASP methodology which sequentially solves a modified version of the basic formulation which considers a single 
traffic demand. Another heuristic is presented in ^ , where the configuration of each single time period is obtained 


by solving a single-period version of the reference MILP. While the exact MILP and the GRASP-based algorithm 
are intended for offline centralized approaches only, the single period heuristic can be applied in an online fashion, 
by solving the single-period problem at the beginning of each time interval or every time the network becomes too 
saturated or too empty. 

While there is a substantial literature on the integration, at the optical layer, of protection techniques with 


energy-aware network management practices (see the related work section in 


6l|), only a few studies have dealt 
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with this problem at the IP layer [60 


[m 

60 

o 

1—1 

103 

and 

61 

|. In 




6l| . In [I03l| two MILP formulations to provide protection to 


single link failures while minimizing the node and link consumption are presented. The first implements dedicated 
protection (see Section [37^ while the second considers a less usual protection scheme, i.e., link protection, according 
to which a backup path is defined between each couple of nodes connected by a link. In both case routing is single 
path, both fixed and flow proportional components are considered present different MILP formulations to reduce 
network consumption while guaranteeing link protection or demand protection. Shared protection in a multi-rate 
scen ario characterized by six different rate/energy states for each device (either routers, either links) is discussed in 
[loJ l. Three MILP formulations considering protection are presented, the first two based on dedicated protection 
and the last one on shared protection. One of the formulation for dedicated protection assumes that backup paths 
have no impact on consumpti on. N ote that the notation used in the paper is not clear and several flaws are present. 
The formulation proposed in [lOsj l and ll02| can be applied offline in a centralized manner. 

In the preliminary work presented in 59j and [60l| , the multi-period problem formulations discussed in 
are integrated to support, respectively, dedicated protection and shared protection. Both papers propose a 
MILP formulation and adapt the single-period heuristic previously mentioned for the unprotected problem to the 
novel protected ones. The authors compare a classic approach where all network elements which carrying at least a 
primary or a backup path are powered-on, and a smart version which allows the switching-off of line cards crossed by 
backup paths exclusively. Furthermore, to further reduce the network consumption, a second utilization threshold 
(larger than the main one) to be respected during failure periods only is introduced. The problem addressed 


58 1 and 


and 


0i 


is further extended in 


^1 


54j to account for robustness to traffic variations. The base formulation is modified 

56l| to manage traffic demand which are uncertain 


to integrate the cardinality constrained method first proposed in 
within a clos e sy mmetric interval. The work presented in 


formulation 


59l 0 and 


54j are finally integrated into a comprehensive 


6 If which is exploited to conduct an overall trade-off evaluation between energy-efficiency and network 


survivability. All the above formulations are suitable for a centralized offline approach, while the single-time period 
heuristic adapted to each specific problem variant can be employed in an online manner. 

A different strategy to provide network resilience in a centralized fashion is proposed in 104| , where the authors 


aim at keeping the failure probability for each traffic demand under a given threshold. The failure probabilities for 
a demand is related to the failure probability of each single link crossed by the routing path, and by the number of 
cables which constitute each link itself. Two heuristic algorithms based on the computation of K-shortest paths for 
each demand (similar to j^) to put to sleep link cables are presented and tested. Both algorithms are suitable for 
on-line and off-line implementation. 

Finally, let us mention some work that adopt less conventional methodologies. The so-called Nash-bargaining 
model is considered in 97| to solve in a centralized and offline fashion an only-link IP-BEANM problem adjusted to 


account for a bi-objective function, where both energy consumption and congestion costs are minimized. Only flow 
proportional consumption components are considered. The authors define and solve a convex programming formu- 
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lation. In [m, 2 and 


the authors address a very particular IP-BEANM problem to model the redundancy 


elimination mechanism, according to which, a subset of routers equipped with enhanced and power hungry capabil¬ 
ities can store the content of the transmitted packets: every time the same content has to be retransmitted toward 
another ’’capable” router, the routers does not send a full packet, but a simple hash which allows the receiver router 
to identify the content in its memory. This mechanism produces a bandwidth reduction, which can be exploited to 
save energy. In 


, a MILP formulation and a heuristic algorithm to put to sleep nodes and links while assuming 


fully splittable routing and deciding whether to activate the redundancy elimination function are presented. New 
cutset inequalities for the same problem are presented in [^, while in the robust version of the problem is 


formulated. As in 


541 and 


6l|, the robust MILP exploits the cardinality-constrained approach formulated in 




to balance the solution robustness. All the proposed approaches are suitable for offline centralized management 
mechanisms. In a novel bi-level centralized optimization approach for EANM with elastic traffic demand (see 


Section 13.9.21) is presented. The authors present an exact MILP formulation with per-flow single path routing and 
a heuristic MILP based on a precomputed set of paths. Energy savings are achieved by putting to sleep network 
links and routers. The computation of the correct transmission rate to be assigned to each elastic flow is performed 
by introducing a group of constraints which model a max-min-fair allocation. Due to the high computing times 
the methodology can be applied offline only. To conclude the part dedicate to flow based routing, let us cite the 
very popular work of Chabarek et al. 2^, which is usually used as reference to prove the prevalence of the fixed 


consumption components in traditional network device. In this paper a MILP for joint energy-aware network design 
and routing with flow based splittable routing is proposed and solved. 

4-2.2. Shortest Path Routing 

The additional constraints and variables required to correctly determine shortest paths, i.e., (I43II51L make 
EANM problems with shortest path routing much more complex than flow-based ones. Thus, even though from the 
practical perspective adjusting the link weights of the shortest path routing protocol seems a very straightforward 
way to perform traffic engineering, the complexity issue has made this optimization problem less tractable and 
less attractive for network scientists. In this field the literature is less rich, but still offers some very interesting 
propos als. 

In 


105 


1061 and 


20|, the authors address an EANM problem with shortest path routing with equal cost 


multi-path, where both li nks and routers can be put t o sle ep and riij - 1 for each link {i,j) e A. The heuristic 


solution first proposed in 


105l| , has been refined first in 


106l| and finally in 


20(1 , where a comprehensive centralized 


offline algorithm to obtain an energy-aware weight setting is described and tested. A peculiarity of this work 
is that once energy consumption is minimized, the proposed procedure then focuses on minimizing a measure of 
network congestion too: more technically, it is equivalent to say that the algorithm lexicographically optimizes, in 
the following order, energy consumption and network congestion. The framework exploits (i) a greedy procedure 


similar to that used in 


64j to quickly put to sleep the more trivial network elements, solves a relaxed version of the 
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corresponding EANM problem where routing is kept flow-based to deactivate the more crucial ones, and (hi) run 


the IGF-WO algorithm proposed in 


40l | to optimize the link weights of the reduced topology. The same algorithm is 


exploited in |107| to build a joint offline-online optimization platform to solve a multi-period version of the problem 
where the goal is to optimize the configuration along an entire day: multiple sets of energy-aware weights are 
computed during a planning phase by the offline algorithm, and then dynamically applied in the network by the 
smart network controller according to real-time traffic measurements. 


Multi-pe riod 


similarly to 


offline energy-aware link weight optimization with sleep-capable links is addressed in , where 


107| the authors propose to determine a finite set of energy-aware configurations and their applicability 


window for OSPF-operated IP. A first genetic algorithm is run to compute a sub-optimal network configuration 
for a certain level of traffic, while a second genetic algorithm is employed to determine when and fr how long each 
configuration will hav e to be applied to minimize the whole consumption and avoid too frequent re-configurations. 
Differently from 107|, only the weights of sleeping elements are adjusted (with very high values which force the 


exclusion from any shortest path tree), and the addressed problem is explicitly exploited to find the sub-optimal 
configurations that satisfy an estimated traffic matrix representing specific levels of traffic. A single configuration 
determines the states of link and routers. Note that in this work, the link weights of active elements are kept 
unchanged. Furthermore, configuration switching are o ptim ized and planned in advance. 


A multi-period scenario similar to that addressed in 


57l | but based on shortest path routing is addressed in 


mi. 


The authors present a novel greedy approach to put to sleep netwo rk lin ks (nq = 1) while minimizing the number o 
weight changes across the different time periods of the day. As in |llo| . only the link weights of sleeping elements 
are modified (with very high values). Furthermore, robustness to traffic variations is included into the framework 


as previously done in 


54l| . The configuration of each time period is computed separately, starting from the that of 


the less to that of the more loaded. The method is suitable for off-line centralized planning. 

Another genetic algorithm to solve in a centralized offline manner a join t opti miza tion problem to minimize both 


network consumption and maximum link utilization is presented in 


1131 and 


114| . Although the authors claim 


to solve a classic FANM problem with multicommodity flow (flow-based routing), the proposed procedure is based 
on the optimization of the link weights of an Interior Gateway Protocol: for this reason we place this work in the 
shortest-path routing section. 

The same problem of 


described in 


2011 where only links can be put to sleep is solved by the set of optimization approaches 


53l| . Starting from a per-path formulation of the problem, the authors build a Lagrangian relaxation 


which is successively used as pillar of three heuristic algorithms: (i) the LR algorithm which progressively updates 
the dual multipliers of capacity constraints and finally converts them into link weights, (ii) the Harmonic Series 
(HS) algorithm based on a local search procedure to update and improve an input set of link weights and (iii) a 
combined LRHS heuristic where the weights computed by the LR algorithm are given as input to the HS. The 
authors affirm that the proposed algorithms, which were originally meant for off-line centralized optimization, are 
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optimization framework too. The LR of the main formulation is also used 


fas t eno ugh to be integrated in an on-line 

in |l2c| by some of the same authors of ^ to solve a protected version of the problem where single node failure 
resilience is provided through optimized link weights. 

The heuristic link weight optimization method proposed in |ll2| to jointly maximize the number of unused links 
and minimize the maximum link utilization assumes that network operators can freely configure the splitting ratios 
among multiple shortest-paths. 

Another work considering s hort est path routing but without the possibility of optimizing the link weights has 
been very recently proposed in [lOsj . The authors consider the table-look operation first discussed in | with flow- 
based routing, and present a new ad-hoc genetic algorithm to s olve the energy minimization problem with shortest 
path routing. The same proposal is successively refined in 109j| , where the authors define a new router power state 


called F^, define and solve the corresponding MILP formulation to decide which router should be put in state 
to minimize energy consumption, and present a heuristic centralized algo rith m to d eal with larger networks. 


A distributed online strategy follows the frameworks proposed in 


116j and 


115 1. Link load information dissem- 

n 


inated through the networks is us ed, a ccording to a given policy, by the whole set of routers [ll6l| , or by each single 


router in an independent manner 


llSjl , to periodically put to sleep a candidate link. If this operation causes other 


links to become saturated, it is immediately reversed. 

Finally, l et us men tion the Energy Aware Routing (EAR) algorithm first presented in 
enhanced in 


118 


liiClit. 

i3. 


llTf and successively 


which address the EANM problem by presenting a heuristic based on a restated version 


of the OSPF protocol. EAR discriminate among Importer Routers (IR), that are exempted from computing their 
own shortest path trees (SPTs) and Exporter Routers (ER) which provide the SPTs to the neighboring IRs. This 
modification of the protocol allows to use a smaller number of active SPTs, which wou ld na tura lly increase the 
number of links not belonging to any shortest path, and thus eligible for sleeping. In 117l | and 118l| the framework 
is traffic unaware and is meant to be applied during night hours only, while in 119| | traffic matrix knowledge is 


introduced to guarantee the quality of service. The optimization problem which is directly solved the choice of IRs 
and ERS which maximizes the energy savings. Practically speaking, a heuristic is obtained by modifying the terms 
of the problem. 

4-2.3. Other Routing Schemes 

For the sake of completeness, here we mention a few other interesting works (not reported in the summary tables) 
which do no deal with neither flow-based nor shortest-p ath routing. Some traffic-unaware heuristic algorithms to 


choose the sleeping elements are described in 


122 


124| . The authors do not refer to any specific routing scheme 


and base their approach on topological features exclusively, e.g., the number of shortest paths crossing each link. 
The idea is to remove from the network the elements which seem to be less critical from connectivity perspect ives . 
Traffic unawareness makes this centralized offline approach suitable for very low traffic conditions only. In 125 | 


the authors consider a tree-based routing scheme adopted in network operated with Carrier Grade Ethernet. Two 
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different bi-objective formulations to balance energy consumption and network performance are proposed. Both 
nodes and links are put to sleep. The trees used to define the possible paths are pre-computed and provided as 
input to the models. 

5. Conclusions 

An important problem inside the green networking literature is the EANM, the energy-aware network manage¬ 
ment problem that deals with reducing network consumption by managing the different resources of the network. 
This paper has given a tutorial view of what are the major issues that influence the different EANM proposals. Next, 
we have explored in-depth the significance of those features in rigorous mathematical programming approaches and 
compared them with other classical modeling features in the operations research literature. The next step was to 
classify the large body of literature according to the problems features or the resolution approaches and, finally, we 
provided a detailed explanation of each of the proposals that could be found up to date. We have found commonality 
in the different approaches and pinpointed those that are particularly rare or present specific features. We hope 
that this tutorial-survey that we have called a “journey through optimization glasses” can shed some light into the 
complex world of energy-aware network management. 
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